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ABSTRACT 

A  linear  programming  model  of  U.S.  Army  Combat  Develop- 
ment Experimentation  Command  is  proposed.   It  provides  a 
planning  tool  which  allows  utility,  expressed  as  relative 
worth,  to  be  maximized  subject  to  resource  constraints. 
Relative  value  of  an  experiment  is  defined  to  be  the  con- 
tribution which  the  experiment  makes  toward  USACDEC's  general 
experimental  objectives.   It  is  derived  by  determining  all 
the  tasks  required  to  accomplish  the  command's  general 
experimental  objectives,  evaluating  the  importance  of  each 
task  in  the  accomplishment  of  the  objectives,  and  determining 
how  many  of  the  tasks  are  accomplished  by  an  experiment. 
This  procedure  leads  to  a  number  which  represents  the 
decision  makers  feelings  about  the  importance  of  the  experi- 
ment.  The  numbers  are  used  as  coefficients  of  a  linear  ob- 
jective function  which  is  maximized  by  a  zero-one  integer 
program.   The  result  is  the  selection  from  a  set  of  ex- 
periments those  which  maximize  relative  value  subject  to 
resource  constraints. 
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I.   INTRODUCTION 

A  manager  must  allocate  available  scarce  resources  to 
his  subordinate  activities  in  such  a  way  that  the  output  of 
the  organization  is  maximized.   He  may  be  able  to  allocate 
the  resources  so  that  the  output  of  a  single  subordinate 
activity  is  maximized  but  will  usually  find  that  the  allo- 
cation is  not  best  for  the  organization  as  a  whole.   His 
decision  is,  then,  how  to  allocate  available  resources  so 
that  the  organization  as  a  whole  will  benefit  most. 

Maximizing  output  subject  to  resource  constraints  has 
been  the  subject  of  much  research  and  exposition.   An  ap- 
proach to  the  problem,  developed  by  Dantzig   for  the  U.S. 
Air  Force,  is  the  technique  of  linear  programming.   Variations 
of  this  approach  have  been  used  to  develop  models  to  help  in 
the  problem  of  capital  budgeting.   These  models  seek  to 
choose  from  alternative  investment  possibilities  the  best 

combination  possible  within  a  given  budget  constraint. 

2 

Hillier   proposes  a  model  for  selection  of  optimal  in- 
vestment proposals  from  a  set  of  proposals  by  maximizing 


1.  Dantzig,  G.B.,  Linear  Programming  and  Extensions, 
Princeton,  N.J.:   Princeton  University  Press,  1963. 

2.  Hillier,  Frederick  S.,"  A  Basic  approach  to  the  Evalua- 
tion of  Risky  Interrelated  Investments,"  in  R.F.  Byrne,  et 
al . ,  Studies  in  Budgeting,  New  York,  N.Y.:  American  Elsevier 
Publishing  Company,  Inc.,  1971. 


expected  utility.   Both  linear  programming  and  a  branch- 

and-bound  algorithm  are  offered  as  solution  techniques. 

3 
Naslund   uses  chance  constrained  programming  (a  linear 

programming  technique  with  probabilistic  constraints)  to 

4 
solve  the  capital  budgeting  problem  and  Byrne   uses  a  similar 

technique  called  two-staged  linear  programming  under 

uncertainty. 

5 
Hartman  and  Moglewer   use  an  approach  based  upon  the 

theory  of  games  to  develop  a  model  for  allocating  resources 
to  research  projects. 

The  purpose  of  this  paper  is  to  address  the  problem  of 
allocating  scarce  resources  for  experimentation  in  support 
of  Army  Combat  Development.   In  particular,  a  model  will  be 
offered  by  which  resources  may  be  efficiently  allocated  to 
carry  out  general  experimental  objectives.   The  organization 
and  functions  of  the  U.S.  Army  Combat  Development  Experimen- 
tation Command  (CDEC)  will  be  presented  as  a  framework  for 
development  of  the  model.   The  underlying  assumptions  and 


3.  Naslund,  Bertil,  "A  model  of  Capital  budgeting  Under  Risk," 
in  R.F.  Byrne,  et  al_.  ,  Studies  in  Budgeting,  New  York,  N.Y.: 
American  Elsevier  Publishing  Company,  Inc.,  1971. 

4.  Byrne,  R.  F. ,  "A  Chance  Constrained  Approach  to  Capital 
Budgeting  with  Portfolio  Type  Payback  and  Liquidity  Constraints 
and  Horizon  Posture  Controls,"  in  R.F.  Byrne,  et  aJ . ,  Studies 
in  Budgeting,  New  York,  N.Y.:  American  Elsevier  Publishing 
Company,  Inc.,  1971. 

5.  Hartman,  Frederick  and  S.  Moglewer.  "Allocation  of  Re- 
source to  Research  Proposals,"  Management  Science,  14:1 
(September,  1967) 


ideas  of  the  model  will  be  discussed  in  detail  and  a  hy- 
pothetical problem  and  its  solution  presented. 

Two  definitions  are  necessary  at  this  point.   The  first 
is  combat  development  which  is 

...the  formulation  of  new  or  improved  army  doctrine, 
organizations,  and  material  objectives  and  the  early 
integration  of  these  products  into  the  Army. 

The  other  is  field  experimentation  which  is 

...a  series  of  field  trials,  under  controlled  con- 
ditions, employing  appropriately  trained  personnel  and 
selected  types  of  equipment  in  functionally  designed 
operational  mixes,  the  actions  and  interactions  of 
which  are  objectively  instrumented,  measured,  and  re- 
corded for  scientific  analysis. 

Combat  development  is  concerned  with  new  ideas  and  con- 
cepts which  may  exist  only  as  mathematical  formulas  or  models. 
At  a  lower  level  of  abstraction  is  field  experimentation, 
used  to  test  hardware  in  order  to  derive  numbers  which  can 
be  used  in  combat  simulations  and  war  games. 

A.  CDEC: EXTERNAL 

Figure  1  gives  the  position  of  CDEC  within  the  Department 
of  Army/Combat  Development  Command  hierarchy.   CDC  directs 
Army  combat  development  activities  under  the  general  guidance 
of  the  Department  of  Army  and  is  the  major  Army  command  re- 
sponsible for  combat  development. 

B.  CDEC: INTERNAL 

Figure  2  gives  the  organization  of  CDEC.   There  are  seven 
important  subelements  within  the  organization,  and  all  combine 


6.   Experimentation  Manual,  USACDCEC,  July  1971.   pp.  1-1/ 
1-2. 


7.   Ibid,  p.  2-1. 
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efforts  to  accomplish  CDEC's  mission  of  field  experimentation 
Keyed  to  Figure  2,    they  are,  in  order,  (and  greatly  simpli- 
fied) : 

1 .  Scientific  Support  Laboratory: 

civilian  contractor;  provides  CDEC  with  technical 
advice  in  experimental  design  and  engineer  support. 

2 .  DCS,  Administration  and  Logistics: 

performs  usual  administration  and  logistic  function. 

3.  DCS,  Plans  and  Programs: 

responsible  for  long  range  experimentation;  planning 
initial  contact  on  all  proposed  experiments;  all  actions 
through  completion  of  Project  Analysis. 

4.  DCS,  Experimentation: 

responsible  for  planning,  execution,  and  reporting 
of  experiments  after  Project  Analysis;  determines  total 
experimentation  requirements. 

5.  DCS,  Instrumentation: 

provides  instrumentation  support  to  field  experimen-- 
tation. 

6.  DCS,  Comptroller; 

performs  the  usual  budgetary  function. 

7.  Experimentation  Brigade: 

provides  command  and  control  for  player  and  other 
support  personnel. 

The  interaction  of  these  elements  may  be  depicted 
graphically  as  in  Figure  3  and  Figure  4,  which  trace  through 
the  organization  a  CDC  concept  which  is  to  be  tested.   These 
charts  also  describe  the  experimental  cycle  which  consists 
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of  the  steps  necessary  to  plan,  conduct,  and  report  a  field 
experiment.   The  primary  concern  here  will  be  with  the  initial 
planning,  in  particular  the  Project  Analysis. 

Action  after  the  Project  Analysis  consists  of  detailed 
planning,  execution,  and  reporting  the  experiment.   The  fact 
that  these  actions  are  not  discussed  further  here  does  not 
mean  that  they  are  not  considered  to  be  important.   To  the 
contrary,  they  are  the  essence  of  the  operation.   Experimen- 
tation can  proceed  without  a  well  defined  plan,  but  not  with- 
out good  execution.   An  experiment  which  is  well  planned  and 
well  executed  will  provide  a  much  better  end  result.   It  is 
the  aim  of  this  paper  to  aid  in  this  planning. 

C.   PROJECT  ANALYSIS 

The  purpose  of  the  project  analysis  is  to  develop  a 
concept  for  experimentation  which  will  best  satisfy  ex- 
perimental objectives  within  available  resource  and  time 
constraints.   Within  this  concept,  a  design  must  be  developed 
that  will  accomplish  experimental  objectives. 

A  project  analysis  may  generally  be  described  as  follows: 
experimental  objectives  contained  in  the  CDC  Experimentation 
Schedule  (or  from  other  sources)  are  analyzed  to  determine 
specific  tasks.   These  general  objectives  are  then  defined 
in  terms  of  actions  which  must  be  taken  and  measurements 
which  must  be  made.   The  analysis  is  done  by  a  project 
analysis  task  group  which  has  in  it  representatives  from  the 
seven   subelements  of  CDEC.   The  project  group  specifically 
considers  such  things  as  constraints  on  location,  resources. 
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and  time,  scenario,  data  requirements,  instrumentation  re- 
quirements, scheduling,  budget  estimates,  and  experimental 
design.   Particularily  interesting  is  the  requirement  for 
the  scheduling  of  resources  by  the  Project  Analysis  Group. 
This  can  become  an  extremely  difficult  task  in  which  a  pro- 
posed experiment  (or  set  of  experiments)  must  be  scheduled 
concurrently  with  other  experiments,  all  of  which  compete 
for  the  same  scarce  resources. 

D.   ALLOCATION  PROBLEM 

Stated  simply  and  briefly,  CDEC ' s  allocation  problem  is 
that  there  are  normally  not  enough  men  and  equipment  to  do 
all  the  experiments  that  CDEC  wants  to  do.   Since  there  is 
not  enough  to  go  around,  how  should  that  which  is  available 
be  allocated?   Should  scarce  resources  be  equally  divided 
among  all  competing  experiments  or  should  more  be  given  to 
the  more  important  experiments?   In  what  sense  is  one  ex- 
periment more  important  than  another?   After  an  allocation 
has  been  proposed  how  can  one  be  sure  that  it  is  the  best? 
Subsequent  sections  will  attempt  to  provide  an  approach  to 
answering  these  questions. 


8.   The  preceeding  discussion  was  based  on  information 
contained  in  Experimentation  Manual,  USACDCEC,  July  1971 
and  USACDCEC  Organization  and  Functions  Manual,  May  1970 
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II.   RELATIVE  VALUE 

This  section  will  attempt  to  provide  an  answer  to  the 
question:  In  what  sense  can  one  experiment  be  more  important 
than  another  experiment?   To  answer  the  question,  the  concept 
of  relative  value  (of  an  experiment)  will  be  introduced, 
defined,  and  described  in  detail.   A  method  by  which  the 
relative  value  of  an  experiment  can  be  derived  will  be 
proposed.   This  method  will  allow  the  relative  value  of  an 
experiment  to  be  expressed  by  a  single  number,  providing 
a  means  of  comparing  the  importance  of  two  different  ex- 
periments.  Relative  value  will  be  defined  in  terms  of  general 
experimental  objectives  and  objective  components.   Quantifi- 
cation of  relative  value  will  be  done  by  an  approach  called 
detailed  component  analysis. 

The  general  idea  for  an  approach  using  the  concept  of 
relative  value  came  from  an  article  in  Operations  Research 
by  Chamberlain  and  Kingsland  which  presented  a  method  for 
measuring  the  contributions  of  proposed  unmanned  missions 
toward  attaining  the  scientific  objectives  of  exploring 
the  solar  system.   Major  objectives  are  first  identified, 
e.g. ,  "Investigate  the  origin  and  evolution  of  life  in  the 
solar  system;  investigate  the  origin  and  evolution  of  the 


1.  Chamberlain,  Robert  G.  and  Louis  Kingsland,  Jr.,  "A 
Methodology  to  Compare  Policies  For  Exploring  the  Solar 
System,"  Operations  Research,  18:4  (July-August,  1970). 
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2 
solar  system."    These  major  objectives  are  then  defined  in 

greater  detail  by  a  set  of  sub-objectives.   An  "objective 

tree"  is  constructed  representing  successive  levels  of  detail 

until  specific  accomplishments  (tasks)  are  identified.   This 

3 
process  is  depicted  m  Figure  5  . 

The  numbers  above  the  sub-objectives  in  Figure  5  are 
determined  by  considering  the  relative  contribution  of  each 
of  the  branches  (sub-objectives)  to  the  next  higher  branch. 
Major  objectives  are  not  assigned  a  value,  so  a  value  rela- 
tive to  all  the  major  objectives  cannot  be  computed.   It 
is  assumed  here  that  the  major  objectives  cannot  be  compared. 
In  order  to  compute  the  contribution  of  a  proposed  mission 
to  a  particular  major  objective,  the  tasks  on  the  tips  of  the 
objective  tree  which  will  be  accomplished  by  the  mission  are 
listed.   For  example,  a  mission  which  only  searched  for 
actual  extraterrestrial  life  on  Mars  and  Venus  would  accomplish 
two  of  the  tasks  at  the  tips  of  the  tree.   They  are  considered 
to  be  worth  .20  and  .70  respectively,  to  the  accomplishment 
of  the  next  higher  branch.   Together  they  accomplish  .90 
of  the  next  higher  branch.   The  next  higher  branch  is  weighted 
.70  and  since  it  is  only  .90  accomplished  the  .70  it  is 
weighted  is  multplied  by  .90.   No  other  subtasks  contribute 
so  the  contribution  of  this  mission  to  the  major  goal  is 
.63  (.90X.70). 


2.  Ibid,  p.  602. 

3.  Ibid,  p.  597. 
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This  general  approach,  with  certain  modifications  and 
extensions,  will  be  used  to  evaluate  experiments.   The  ap- 
proach will  be  modified  so  that  major  objectives  will  be 
compared  and  will  be  extended  to  consider  experiments  of 
the  type  performed  by  CDEC. 

The  preceeding  description  hints  at  the  idea  of  relative 
value  to  be  used  in  this  paper.   Fishburn  says  that  it  is 
"...assumed  meaningful  to  consider  a  set  of  real  numbers  ... 

to  describe  the  relative  importance  of  the  consequences  to 

4 
the  decision  maker,"  . 

He  admits  that  it  is  theoretically  possible  to  measure 

this  number  but  indicates  that  there  are  great  practical 

difficulties  caused  by  the  requirement  to  measure  and  use 

subjective  probabilities.   These  difficulties  are  caused  by 

the  large  number  of  consequences  which  the  decision  maker 

must  consider  and  by  his  ability  to  state  his  preferences 

honestly  and  without  ambiguity.   Other  problems  are  the  fact 

that  objectives  may  be  uncertain  and  preferences  may  change 

over  time.   The  undesirable  consequence  of  such  an  assumption 

is  that  an  individual's  stated  preference  may  not  accurately 

5 
reflect  his  true  feelings. 

Although  he  assumes  that  it  is  possible  for  relative  value 

to  exist,  he  declares  that  any  attempt  to  measure  a  unique 


4.  Fishburn,  Peter  C.  Decision  and  Value  Theory,  New  York: 
John  Wiley  &  Sons,  Inc.,  1964,  p.  123. 

5.  Ibid,  pp.  84-87. 
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number  is  at  best  approximate.    The  important  idea  is  the 
ability  to  represent  importance  to  the  decision  maker  by  a 
number  and  the  fact  that  that  number  will  probably  be  only 
approximate.   Fishburn  is  also  strongly  against  the  idea  that 
the  magnitude  of  importance  can  be  represented  by  the  magnitude 
of  a  number  and  that  a  consequence  or  event  with  a  number 
.80  assigned  to  it  is  twice  as  important  as  a  consequence 
with  .40  assigned  to  it.   The  ability  of  a  decision  maker  to 
do  this  is  questionable  and  schemes  using  subjective  prob- 
abilities have  been  devised  to  get  around  the  problem.   Other 

authors  feel,  however,  that  the  test  of  a  concept  should  be 

7  8 

whether  or  not  it  produces  results.   Pardee   and  Miller 

have  approached  the  concept  in  this  fashion  and  this  paper 
will  approach  it  in  the  same  manner. 

Miller  formulated  a  procedure  for  assessing  worth  and 
designed  an  experiment  to  test  whether  or  not  professional 
decision  makers  could  implement  the  procedure  and  with  what 
degree  of  success.   The  experiment  was  performed  on  students 
at  the  Defense  Weapons  System  Management  Center  at  Wright- 
Patterson  Air  Force  Base,  Dayton,  Ohio.   It  involved  a  set 
of  decisions  the  students  made  while  at  the  school  and  it 
indicated  that  the  worth  assessment  procedure  can  be  used  to 


6 .  Ibid,  p.  123 . 

7.  Pardee,  F.S.,  et  al . ,  Measurement  and  Evaluation  of 
Transportation  System  Effectiveness ,  Santa  Monica:  The  Rand 
Corporation,  1969. 

8.  Miller,  James  R.  III.  Professional  Decision  Making, 
New  York:  Praeger  Publishers,  1970. 
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assess  alternatives  and  can  be  used  to  make  decisions  as  long 
as  the  process  reflects  what  the  decision  maker  wants  it  to 
reflect. 

The  method  that  will  be  followed  closely  here  is  developed 
by  Parde,  et  a]^.   It  recognizes  the  problems  pointed  out  by 
Fishburn,  but  trys  to  develop  a  model  that,  if  understood  and 
properly  used,  will  yield  results. 

A.   RELATIVE  VALUE  OF  AN  EXPERIMENT: 

The  relative  value  of  an  experiment  will  be  defined  in 
terms  of  experimental  objectives  and  objective  components. 
These  two  ideas  are  defined  as: 

1 .  Experimental  Objectives: 

The  goals  toward  which  an  experiment  or  set  of  ex- 
periments are  conducted.   These  are  assumed  to  be  known  to 
CDEC  decision  makers  and  planners  and  may  be  long  range  or 
confined  to  a  particular  time  period.   They  may  be  such     * 
goals  as  finding  information  about  new  equipment  or  concepts 
and  may  be  internally  generated  or  directed  by  CDC. 

2 .  Objective  Components: 

The  sub-objectives  and  specific  tasks  which  if  ac- 
complished will  complete  all  of  the  experimental  objectives. 

It  is  assumed  that  at  any  point  in  time  a  set  of 
experimental  objectives  and  objective  components  exists  and 
is  known  to  the  planners  and  decision  makers  of  CDEC.   That 

9.   Ibid.,  p.  195. 
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is,  they  know  what  must  be  done  and  all  the  tasks  required 
to  do  it.   The  relative  value  of  an  experiment  is  it's  contri- 
bution toward  accomplishing  the  experimental  objectives. 

B.  METHODOLOGY:  GENERAL: 

A  number  must  be  assigned  to  each  experiment  to  represent 
its   relative  value.   Pardee  assigns  value  to  transportation 
systems  by  assigning  something  called  worth  to  the  lowest 
level  of  his  objective  tree.   These  values  are  then  carried 
up  through  the  tree  to  give  a  value  for  the  proposal.   Here, 
the  lowest  tasks  receive  value  of  0  or  1  depending  on  whether 
or  not  a  proposed  experiment  accomplishes  a  task.   If  the 
task  is  accomplished  it  is  assigned  a  value  of  1.0;  if  not, 
it  is  assigned  a  value  of  0.0.   Before  a  number  for  the 
relative  value  of  the  experiment  can  be  arrived  at,  the 
relation  of  all  the  experimental  components  must  be  stated. 
This  is  the  process  described  earlier  in  which  the  contribu- 
tion of  each  sub-branch  of  a  branch  is  evaluated  relative 
to  the  other  sub-branches  in  that  branch.   Once  these  numbers 
are  available,  computing  the  relative  value  of  an  experiment 
is  an  easy  task. 

C.  DETAILED  COMPONENT  ANALYSIS: 

This  is  a  process  in  which  objective  components  are  stated 
and  contributions  to  higher  objectives  determined.   Again  it 
must  be  emphasized  that  it  is  assumed  that  experimental 
objectives  can  be  decomposed  by  planners  and  decision  makers 
until  specific  tasks  are  stated.   These  must  be  tasks  which 
people  who  carry  out  experiments  can  understand  and  perform. 
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It  is  necessary  to  distinguish  between  the  relative  value 
of  an  experiment  and  the  relative  contribution  of  a  component 
to  a  higher  objective.   The  term  weight  will  be  used  to 
describe  the  relative  contribution  of  a  component.   The 
weights  assigned  to  all  the  components  resulting  from  the 
decomposition  of  experimental  objectives  will  be  used  to 
determine  the  relative  value  of  an  experiment. 

1.   Assignment  of  Weights  to  Components: 

The  procedure  for  assigning  weights  follows  the 
general  idea  expressed  in  the  space  exploration  example 
and  in  particular  follows  closely  an  algorithm  given  by 
Pardee.     This  procedure,  slightly  modified  to  fit  in  the 
experimental  framework  is  as  follows: 

a.  Define  a  set  of  weights  for  every  component  which 
is  subdivided.   Each  sub-division  is  assigned  a  number. 

b.  The  number  assigned  to  each  component  sub- 
division is  interpreted  as  the  perceived  relative  importance 
of  each  sub-division  in  accomplishing  the  component  of  which 
it  is  a  part. 

c.  Relative  importance  will  be  reflected  in  the 
ratios  of  assigned  weights. 

d.  Weights  will  be  in  the  range  0.0  to  1.0. 

e.  Weights  are  assigned  by  pairwise  comparison  of 
sub-divisions. 


10.  Pardee,  op.  cit . ,  pp.  420-422 
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2 .   Pairwise  Comparison 

Sub-divisions  are  listed  in  order  of  importance  and 
the  number  1.0  assigned  to  the  most  important  (first  in  the 
list) .   Next,  the  second  sub-division  is  compared  to  the 
first.   If  accomplishment  of  the  second  sub-division  seems 
only  1/2  as  important  as  the  first,  then  the  number  .50  is 
assigned  to  it.   Then  compare  the  second  and  third  sub- 
division and  assign  a  number  to  the  third  which  reflects 
it's  importance  relative  to  the  second,  multiply  this  number 
by  the  number  assigned  to  the  second  and  assign  the  product 
to  the  third  sub-division.   For  example,  if  the  second  sub- 
division were  assessed  as  being  1/2  as  important  as  the  first 
and  the  third  1/5  as  important  as  the  second  the  number  as- 
signed to  the  third  would  be  1/2  x  1/5=  1/10=  .10.   Repeat 
this  procedure  until  the  list  is  exhausted.   Finally,  sum 
all  the  assigned  numbers  and  divide  each  assigned  number  by 
the  sum.   This  will  give  a  set  of  positive  numbers  which 
sums  to  1.0  and  preserves  the  ratios  of  any  pair  of  weights. 

D.   ILLUSTRATION 

The  above  process  will  now  be  illustrated  by  a  hypothet- 
ical example.   Assume  that  there  are  only  two  experimental 
objectives  Oiand  O2.   Let  0 1  be  a  requirement  to  gather  data 
about  the  optimum  size  of  the  infantry  squad  and  let  O2 
be  a  requirement  to  gather  data  about  optimum  ratio  of 
observation  helicopters  to  attack  helicopters  in  the  attack 
helicopter  team.   The  decomposition  of  the  experimental 
objectives  is  dipicted  in  Figure  6. 
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First  consider  the  relative  importance  of  the  two  ob- 
jectives to  the  overall  objective,  i.e.  accomplishing  all 
experimental  objectives.   The  planners  may  feel  that  the 
two  are  not  equally  important  and  will  list  them  in  order 
of  importance,  e.g.,  [Oi,  O2]/  Oi  being  more  important.   The 
first  step  is  to  assign  to  0 1  a  value  of  1.0.   Now  consider 
O2.   The  planner  feels  that  it  is  only  2/3  as  important  as 
Oi  hence  he  assigns  the  number  2/3  to  it.   Next  the  assigned 
numbers  are  added  giving  1.0  +  2/3  =  5/3.   Each  assigned 
number  is  divided  by  5/3  giving  Iv  5/3  =  3/5  =  .60  and 
2/3-^  5/3  =  2/5  =  .40.   Therefore  Oi  has  a  weight  of  .60 
and  O2  has  a  weight  of  .40.   The  remaining  weight  assignments 
have  been  computed  and  are  shown  in  Figure  7.   The  experimental 
objectives  have  been  decomposed  into  components  and  weights 
have  been  assigned  to  them,  completing  the  detailed  component 
analysis. 

E.   RELATIVE  VALUE  OF  AN  EXAMPLE  EXPERIMENT 

The  state  of  each  of  the  lowest  level  components  located 

at  the  tips  of  the  "objective  tree"  can  be  described  by  a 

variable  X.  ,  where 
3 

1  if  component  j  is  to  be  performed 
X.  = 

0  if  component  j  is  not  to  be  performed 

Assume  that  an  experiment,  consisting  of  some  of  the  X. 

is  proposed.   For  example,  an  experiment  Ei  could  be  the  set 
of  components  [Xi,  X3].   This  experiment  would  consist  of 
gathering  data  about  optimum  size  of  infantry  squads  at 
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night  on  trails  and  during  the  day  on  trials.   All  of  the 
components  Xi  through  Xio  (and  hence  both  experimental  ob- 
jectives) would  be  accomplished  by  the  following  set  of 
experiments: 
El  =[Xi,X3]  E2  =[X2,    Xh]     E3  =[X5/  Xe]  E^  =[X6,  X9]  E5  = 

[Xg,   Xi  0 ] 

Now  it  is  possible  to  determine  the  relative  value  of 
each  of  the  proposed  experiments.   For  each  experiment 
assign  a  number  to  all  X.  associated  with  the  objective  tree; 
X.  =  1  if  the  experiment  will  accomplish  component  j,  X.   = 
0  if  not.   Multiply  X.  times  the  weight  of  the  component 
with  which  it  is  associated.   Beginning  with  the  lowest  level, 
sum  the  products  of  component  weight  and  X .  for  components 
which  are  sub-divisions  of  the  same  branch.   Next,  multiply 
this  sum  times  the  weight  of  the  next  higher  branch.   This 
gives  a  new  tree,  reduced  in  detail  by  one  level.   Continue 
until  one  number  is  obtained. 

For  example,  consider  E2  and  refer  to  Figure  7.   Since 
Xi  and  X3  are  to  be  done  by  this  experiment,  Xi  and  X3  are 
assigned  the  value  1.0  and  X2  /  Xit ,  X5 ,  Xe ,  X?  ,  Xs  ,X9 ,  Xi  0  are  all 
assigned  the  value  0.0.   Examine  the  "night"  branch  of  Oi. 
Since  X2  is  zero  (it  is  not  done  in  this  experiment)  it  has 
no  value.   Xi  is  1.0  however,  and  contributes  value.   The 
first  step  then,  is  to  multiply  .20  by  1.0  and  .80  by  0.0. 
Add  these  two  values  to  get  .20.   Next  multiply  .2  by  .6 
(the  weight  of  the  next  higher  branch)  to  get  .12.   In  the 
same  manner  in  the  "day"  branch  .40  x  .40  =  .16.   Thus  the 
"night"  branch  contributes  .12  and  the  "day"  branch  .16  for 
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a  total  of  .28.   There  is  no  contribution  from  O2  so  the 
relative  value  of  the  experiment  is  .28  times  the  weight  of 
Oi  or  .168.   Evaluation  of  the  remaining  experiments  gives 
relative  values  of 
Ci  =  .168   C2  =  .432   C3  =  .176  Ci,    =  .104   C5  =  .120 

These  numbers  indicate  that  experiment  two  (E2)  would 
yield  the  greatest  contribution  toward  the  overall  experimental 
objectives.   Experiment  five  gives  the  least  contribution. 
If  only  one  of  the  experiments  can  be  carried  out,  then 
experiment  two  would  be  the  logical  choice,  assuming  that 
the  costs  of  the  experiments  is  not  considered. 

This  completes  the  discussion  of  relative  value.   It 
allows  the  value  judgements  of  planners  and  decision  makers 
to  be  stated  explicitly.   It  is  difficult  to  justify  theo- 
retically, but  if  it  reflects  accurately  the  decision  maker's 
assessment  of  the  importance  of  experiments  it  can  be  a 
useful  tool. 

If  the  preceeding  is  acceptable  to  the  decision  maker, 
he  can  now  discriminate  between  different  experiments  and 
can  get  a  feeling  for  how  an  experiment  will  contribute  to 
his  over  all  goals.   Suppose,  however,  that  the  resources 
necessary  to  complete  all  the  experiments  are  not  available. 
If  this  is  the  case,  then  only  some  of  the  experiments  can 
be  done.   If  there  is  only  one  resource  to  be  considered, 
then  experiments  are  chosen  in  descending  order  of  the  ratio 
of  the  relative  value  to  the  amount  of  the  resource  required. 
If  there  is  more  than  one  resource  involved  the  problem 
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becomes  much  more  complicated  and  must  be  approached  by  some 
form  of  linear  programming. 
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III.   THE  MODEL 

The  purpose  of  this  section  is  to  introduce  a  linear 
programming  model  of  CDEC.   The  assumptions  of  the  model 
will  be  stated,  the  model  described,  and  illustrated  by  a 
continuation  of  the  hypothetical  example  of  section  II.   It 
will  be  assumed  that  the  reader  has  a  knowledge  of  the 
techniques  of  linear  programming. 

A.   OBJECTIVE  FUNCTION 

In  the  model,  experiments  are  represented  by  the  variable 
E..   The  model  assumes  that  the  output  of  CDEC  can  be  rep- 
resented as  a  linear  function  of  the  experiments  to  be 
performed,  i.e., 

Z  =  CiEi  +  C2E2  +  . . .  +  C .E . 
The  contributions  of  different  experiments  to  the  objective 
function  are  assumed  to  be  independent  of  other  experiments. 

Resources  will  be  represented  by  b.  where  b.  is  the 
amount  of  the  ith  resource  available.   Resources  are  related 
to  experiments  by  a. .,  the  amount  of  the  ith  resource  required 
for  the  jth  experiment.   Now  the  model  can  be  stated  (for 
two  experiments  and  two  resources)  as 

Max  Z  =   CiEi  +  C2E2 
s . t .    ai lEi  +  ai 2E2 
ai 2E1  +  a2  2E2 

It  is  assumed  that  the  amount  of  resource  required  by 
one  experiment  does  not  affect  the  amount  required  by  another. 
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In  this  model  Z  will  represent  relative  value  as  defined 

in  the  previous  section.   The  coefficients  C.  will  be  the 

D 

numbers  derived  to  represent  the  contribution  of  each  E .  to 

D 

accomplishment  of  all  experimental  objectives.  Using  the 
numbers  from  the  previous  example,  the  objective  function 
for  that  five  experiment  case  is 

Z  =  .I68E1   +  .432E2   +  .I76E3   +  .104E^   +  .I2OE5 
For  reasons  which  will  be  discussed  later,  let 

Z  -=  lOOOZ  =  I68E1   +  432E2   +  I76E3   +  104E.,   +  I2OE5 

B.   RESOURCE  CONSTRAINTS 

For  clarity  of  presentation,  from  this  point  on  the  model 
will  be  discussed  in  terms  of  the  example  in  section  II.   As- 
sume that  the  five  experiments  only  require  three  resources; 
i.e. ,    instrumentation,  helicopters,  and  men,  and  let  the 
amount  of  instrumentation  available  be  bi;   helicopters, 
ba;  and  men,  ba.   The  model  is  now 

Max  Z  =  I68E1  +  432E2  +  I76E3  +  104Ei.  +  I2OE5 
s.t.    aiiEi  +  ai2E2  +  aisEs  +  aiitEif  +  aisEs  <_  h\ 
a2iEi  +  a22E2  +  a23E3  +  azh'Ek    +   a25E5  <_  b2 
a3iEi  +  a32E2  +  a33E3  +  a3t,Eit  +  aasEs  <_  b3 

To  this  point  no  restriction  has  been  placed  on  E  .  .   It 
will  be  assumed  that  an  experiment  will  either  be  completely 
done  or  not  done  at  all.   This  allows  E.  to  have  only  zero 
or  one  for  a  value. 

The  model  will  now  be  extended  one  step  further  by  as- 
suming that  resource  availability  is  time  dependent.  This 
means  that  resource  requirements  and  availabilities  can  vary 
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from  time  period  to  time  period.   For  simplification  four 

time  periods  are  assumed.   The  model  now  is  as  shown  in 

k       k 
Figure  8.   The  superscript  k  on  a. .  and  b.  indicates  the 

time  period.   The  model  in  Figure  8  is  for  two  time  periods, 
two  experiments,  and  two  resources. 

Resources  for  the  example  situation  are  shown  in  Figure 
9.   Further  information  about  specific  experiments  is  in- 
cluded in  this  chart.   Notice  that  not  all  experiments  re- 
quire all  four  time  periods.   If,  for  example,  an  experiment 
requires  only  three  time  periods,  it  is  possible  to  begin 
that  experiment  either  in  time  period  one  or  time  period 
two.   (It  is  assumed  that  experiments  cannot  be  broken  up, 
i.e.  they  must  run  on  consecutive  days.)   This  gives  in 
effect  two  experiments,  both  of  which  must  be  considered 
when  a  maximum  for  Z  is  sought.   For  example,  consider  Ea 
which  requires  no  resources  for  one  period  and  some  resources 
the  other  three.   E2  can  start  either  in  period  one  or  period 
two.   It  cannot  start  any  later  than  period  two  since  a  later 
starting  time  would  not  allow  the  experiment  to  be  completed. 
E2  must  now  be  described  by  two  variables,  say  Hi  and  H2, 
and  since  only  one  of  this  set  is  to  be  performed,  the  ad- 
ditional constraint  that  Hi  +  H2  =  0  or  1  is  added.   This 
constraint  says  that  either  Hi  or  H2  but  not  both  can  enter 
the  linear  program  solution.   This  last  constraint  has  the 
further  advantage  that  it  provides  a  schedule  of  the  ex- 
periments which  are  selected. 
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Max    Z=CiEi+C2E2 

s.t.  ail  El  +  ai2  E2<  bi 

2             2  2 

ail  El  +  a  1 2  E2£  bi 

1  1  1 
32  1  El  +  a22  E2<  b2 

2  2  2 

a2 1  El  +  a2  2  E2<  b2 


Figure  8 
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RESOURCE  AVAILABILITIES 


RESOURCE 


PERIOD  1 


PERIOD  2 


PERIOD  3   PERIOD  4 


Instrumentation      100 
Helicopters  30 

Men  500 


110 

30 

500 


110 

32 

500 


120 

35 

500 


EXPERIMENTAL  REQUIREMENTS 


E 


Instrumentation 

30 

30 

Helicopters 

5  , 

5 

Men 

200 

200 

E- 


Instrumentation 

0 

50 

50 

50 

Helicopters 

0 

5 

5 

5 

Men 

0 

200 

200 

200 

E 


Instrumentation 

0 

40 

40 

40 

Helicopters 

0 

20 

20 

20 

Men 

0 

100 

100 

100 

El 


Instrumentation 

30 

30 

Helicopters 

15 

15 

Men 

80 

80 

Es 


Instrumentation 

Helicopters 

Men 


20 
10 
50 


Figure  9 
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C.   ILLUSTRATION 

The  complete  model  will  now  be  illustrated  by  the  example 
data  provided  in  Figure  9.   The  five  experiments  have  been 
extended  to  fourteen  by  the  reasoning  just  described.   The 
problem  is  dipicted  in  Figure  10. 

1.  Solution  Procedure 

Solution  of  the  example  in  Figure  10  is  by  an  integer 
programming  routine  called  ARRIBA.   (See  Appendix  A) .   The 
program  is  not  zero-one  but  by  specifying  that  each  variable 
be  less  than  or  equal  to  one  a  zero-one  program  is  obtained. 
A  solution  requires  only  that  data  consisting  of  the  coef- 
ficients (C . )  of  the  objective  function  (Z)  and  the  coef- 

k       k 
ficient  matrix  of  a. .  and  b.  be  entered.   Since  the  program 

ij  1  f    ■:) 

is  integer  zero-one  an  objective  function  with  fractional 
or  decimal  coefficients  would  give  a  trivial  solution  with 
all  E.  equal  zero.   For  this  reason  Z  is  transformed  to  get 
rid  of  the  decimals  in  the  original  objective  function. 

2 .  Solution 

The  solution  of  the  example  in  Figure  10  is  given  in 
Figure  11.   The  detailed  solution,  shown  in  the  computer 
output  appendix,  gave  the  following  values  for  the  fourteen 
variables:   Hi  =  Ha  =  H5  =  He  =  H?  =  He  =  Hg  =  H i i  =  H i 3  = 
Hilt  =  0  and  H  3  =  Hi+  =  Hi  0  =  Hi  2  =  1  •   None  of  the  variables 
which  make  up  experiment  three  (He,  H7)  were  assigned  a 
value  of  one,  so  that  experiment  was  not  performed  at  all. 
Experiment  four,  with  a  smaller  contribution  (relative  value) 
than  experiment  three,  was,  however,  chosen. 
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3 .   Comment 

The  model  can  be  described  as  a  zero-one  linear 
programming  model  which  has  as  an  objective  the  maximization 
of  relative  value.   Relative  value  is  arrived  at  by  considera- 
tion of  experimental  objectives  and  a  detailed  component 
analysis.   Resource  availabilities  and  requirements  by  time 
period  are  assumed  to  be  known.   The  solution  of  the  linear 
program  is  in  the  form  of  an  experimental  schedule  and  is 
arrived  at  by  a  prepackaged  computer  program. 

An  answer  has  now  been  offered  to  the  question  of 
how  resources  should  be  allocated  to  competing  experiments. 
A  model  has  been  described  and  given  substance  by  an  example. 
Now  questions  arise  about  the  form  of  the  model  and  some 
examination  must  be  made  of  how  sensitive  it  is  to  changes 
in  its  form,  specifically,  how  will  it  react  to  changes  in 
the'  coefficients  of  the  objective  function  and  the  b.. 
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IV.   SENSITIVITY  ANALYSIS 

This  section  will  examine  the  effect  of  changes  in  the 
amount  of  available  resources  and  coefficients  of  the  ob- 
jective function.   The  effect  of  relaxing  the  assumption 
that  experiments  must  be  performed  in  consecutive  time 
periods  will  be  considered  as  will  a  solution  arrived  at  by 
relaxing  the  requirement  that  the  experiment  be  performed 
or  not  performed  (zero-one  assumption) . 

A.   CHANGES  IN  THE  OBJECTIVE  FUNCTION 

In  the  example  problem  Oi  was  valued  at  .60  and  O2  at 
.4.   The  value  of  the  C.  in  the  objective  function  depends 
upon  the  value  of  Oi  and  O2  and  the  C.  change  as  they  change. 
Oi  was  allowed  to  vary  from  .1  to  .9  and  O2  varied  accordingly 
New  values  for  C .  were  computed  for  each  of  the  nine  values 
of  Oi  and  O2.   These  values  appear  in  Figure  12.   The  sched- 
ule corresponding  to  these  values  appear  in  Figure  13.   For 
Oi  =  .1,  O2  =  .9;  Oi  =  .2,  O2  =  .8;  Oi  =  .3,  O2  =  .7,  the 
solution  was  schedule  one  in  Figure  13.   For  the  remainder 
the  solution  was  schedule  two  in  Figure  13. 

Varying  the  weights  of  the  two  experimental  objectives 
gave  a  change  in  schedule.   That  change  deleted  experiment 
three  from  schedule  one  and  added  experiments  one  and  four. 
Experiment  two  was  unchanged,  but  experiment  five  was  moved 
from  period  four  to  period  one. 

The  model  was  fairly  insensitive  to  changes  in  the  weight 
of  Oi  and  O2  since  there  was  only  one  change  of  schedule  as 
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these  values  varied  over  the  range  which  they  were  allowed 
to  assume. 

B.   RELAXATION  OF  RESOURCE  CONSTRAINTS 

Consider  the  effects  of  relaxing  each  binding  resource 
constraint  for  a  solution.   The  value  of  the  objective 
function  (z)  can  change  as  can  the  solution  schedule.   In 
a  normal  linear  program  the  increase  in  the  objective  function 
as  binding  constraints  are  relaxed  can  be  used  to  imput  a 
value  to  resources. 

This  concept  cannot  be  used  in  integer  programming. 
Consider  again  the  solution  to  the  example  problem  in  which 
the  value  of  the  objective  function  for  the  solution  is  824, 
and  the  binding  constraint  (slack  is  zero)  is  instrumentation 
in  the  third  time  period.   When  the  number  of  men  available 
in  this  period  was  changed  from  110  to  300  the  value  of  the 
objective  function  changed  to  896  with  the  schedule  shown 
in  Figure  14.   There  were  then  three  binding  constraints, 
i.e.  instrumentation  in  the  fourth  time  period  and  men  in 
both  the  third  and  fourth  periods.   (See  Figure  15).   When 
these  three  constraints  were  relaxed,  the  new  value  of  Z  was 
896  with  the  same  schedule.   Further,  there  were  no  binding 
constraints. 

When  the  first  constraint  was  relaxed,  the  objective 
function  increased  from  824  to  896  for  an  increase  of  ten 
units  of  instrumentation.   This  increase  would  not  have 
occured,  however,  for  any  increase  smaller  than  ten.   It 
took  exactly  ten  units  to  get  the  increase,  whereas  in  a 
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normal  linear  program  some  increase  in  Z  would  have  been 
noted  for  an  increase  of  one  unit.   In  a  normal  linear 
program  the  imputed  value  of  a  unit  of  instrumentation  would 
be  52/10  =  5.2.   This  implies  that  five  units  of  instrument- 
ation would  produce  an  increase  of  26  in  the  objective 
function.   This  is  clearly  not  the  case  for  an  integer 
program. 

C.   NONCONSECUTIVE  SCHEDULING 

It  was  previously  assumed  that  experiments  could  not 
be  broken  up,  i.e .  that  once  begun  they  must  be  run  until 
completed.   An  example  similar  to  the  initial  example  was 
solved  under  this  assumption  and  then  with  the  assumption 
relaxed.   The  example  chosen  has  three  experiments  and  three 
resources  and  uses  the  same  Cj^ ,  C^  and  C3  of  the  initial 
example.   The  problems  are  stated  in  Figures  16  and  17. 
Note  that  the  first  problem  (under  the  initial  assumption) 
has  seven  variables  whereas  the  second  has  fourteen.   This 
need  for  more  variables  is  a  distinct  disadvantage  or 
relaxing  the  assumption. 

The  advantage  of  relaxing  the  assumption  is  clear  in 
the  solution  schedule  in  Figure  18  and  in  the  value  of  the 
objective  function.  Under  the  assumption  of  consecutive 
scheduling  only  one  experiment  could  be  performed  with  a 
value  for  Z  of  432.  The  other  scheduling  assumption  al- 
lowed two  experiments  for  a  value  of  600. 
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D.  INTEGER  PROGRAM 

If  the  five  experiments  in  the  example  are  considered 
to  be  iterations  of  an  experiment  rather  than  a  complete 
experiment,  then  the  zero-one  requirement  of  the  program 
can  be  disregarded.   The  same  objective  function  can  be 
used  but  it  can  take  on  values  greater  than  1000,  since  now 
experiments  can  be  scheduled  more  than  once.   The  C.  are  no 
longer  relative  value  as  it  was  earlier  defined,  but  are 
viewed  as  an  indication  of  the  value  of  an  iteration  of  an 
experiment.   This  procedure  was  applied  to  the  initial 
example  with  all  "less  than  or  equal  to  one"  constraints 
removed.   The  solution  schedule  is  in  Figure  19.   It  recom- 
mends that  experiment  one  be  done  twice  and  that  experiment 
five  be  done  eight  times,  twice  during  each  period. 

E .  COMJNIENT 

It  appeared  that  the  model  will  provide  different  sched- 
ules for  different  values  of  the  coefficients  of  the  objective 
function  allowing  the  planner  and  decision  maker  to  reflect 
a  change  in  his  priorities.   Changes  in  resource  constraints 
also  gave  different  schedules,  but  only  for  discrete  jumps  in 
the  availability  of  resources. 
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V.  .  CONCLUSIONS 

The  model  gives  a  planner  or  decision  maker  an  approach 
to  the  problem  of  how  to  allocate  resources  so  that  ex- 
perimental objectives  are  best  met.   The  measure  of  ef- 
fectiveness of  resource  allocation  is  the  degree  to  which 
experimental  objectives  are  met.   A  detailed  analysis  of 
how  proposed  experiments  can  be  done  and  a  subjective  eval- 
uation of  the  relative  importance  of  the  components  which 
comprise  the  total  experimental  plan  is  required  to  derive 
this  measure  of  effectiveness.   The  measure  of  effectiveness 
is  transformed  into  a  linear  relationship  of  experiments  and 
this  linear  relationship  is  then  maximized  subject  to  resource 
constraints . 

Resource  constraints  are  given  by  time  period  as  are 
experimental  requirements.   The  linear  program  is  then 
solved  by  an  integer  zero-one  linear  program  algorithm  pro- 
viding a  solution  in  the  form  of  an  experimental  schedule. 

A.   CAPABILITIES  OF  THE  MODEL 
1 .   Planning 

The  model  is  a  planning  tool  which  can  be  used  to 
predict  gross  over-commitments  or  under  use  of  resource. 
Subjective  feelings  of  planners  about  the  importance  of 
competing  experiments  are  made  explicit  in  the  objective 
function,  the  coefficients  of  which  can  be  readily  varied 
as  changes  in  priorities  occur.   Changes  in  the  parameters 
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of  the  model  (resource  requirements  and  availabilities)  can 
be  made  with  little  effort,  allowing  the  planner  to  examine 
how  changes  in  these  parameters  will  effect  the  current 
schedule. 

2.   Resource  Allocation 

The  model  establishes  for  the  planner  a  link  between 
the  value  of  experiments  and  resources.   The  link  may  appear 
tenuous  but  can  still  give  him  an  indication  of  the  efficiency 
of  his  resource  allocation. 

B.   SHORTCOMINGS 

1 .   Subjective  Evaluation 

The  model  allows  the  planner  to  make  explicit  sub- 
jective evaluations,  but  he  must  remember  that  the  fact  that 
the  evaluations  are  stated  does  not  make  them  more  objective. 
For  this  reason  care  must  be  taken  when  decisions  are  to  be 
made  and  final  decisions  regarding  schedules  should  be  based 
on  a  firmer  basis  than  is  provided  by  the  model.   The  sched- 
ule proposed  by  the  model  should  be  only  one  of  the  factors 
which  the  manager  uses  in  arriving  at  a  solution. 
■  2 .   Uncertainty 

The  model  does  not  consider  uncertainty  because  it 
is  beyond  the  scope  of  this  paper.   It  is  clear  that  the 
future  availability  of  resources  and  the  future  requirements 
for  experiments  are  uncertain.   A  change  in  the  structure  of 
the  experiment  can  change  the  requirements  for  that  experiment 
and  the  reliability  of  equipment  and  availability  of  personnel 
can  never  be  accurately  predicted.   It  is  assumed  that  the 
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planner  will  provide  the  model  with  the  best  information 
available  and  will  update  the  model  as  new  information  be- 
comes available. 

3.   Assumptions 

As  previously  noted,  the  model  assumes  that  the 
worth  contributed  to  the  relative  value  of  a  proposed  set 
of  experiments  by  each  separate  experiment  is  independent 
of  the  other  experiments.   This  allows  the  separate  worths 
to  be  added.   If  this  assumption  is  not  true  and  hence  the 
objective  function  and/or  the  constraints  are  not  linear, 
a  grossly  inefficient  allocation  may  be  proposed  by  the 
model. 

C.   FURTHER  STUDY 

1 .  Uncertainty 

As  was  indicated  earlier  uncertainty  in  linear  pro- 
gramming has  been  approached  by  the  techniques  of  linear 
programming  under  uncertainty  and  chance  constrained  linear 
programming.   Uncertainty  could  be  introduced  into  this  model 
by  either  of  these  techniques  or  by  a  PERT-type  technique 
which  would  assume  some  beta  distribution  for  resources. 
Past  experience  could  be  used  to  derive  means  and  variances 
of  available  resources  and  the  information  projected  into 
the  future. 

2 .  Other  Solution  Procedures 

Network  algorithms  which  offer  a  more  exact  solution 
to  the  integer  linear  program  are  available.   An  alternate 
solution  procedure  could  possibly  be  based  on  such  a  technique 
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3.  Validation 

The  model  should  be  applied  to  an  actual  resource 
allocation  problem  in  an  organization  such  as  CDEC  and  the 
resulting  schedules  compared  with  schedules  arrived  at  by 
normal  procedure.   This  would  require  on  the  part  of  the 
planners  involved  an  understanding  of  the  concept  of  relative 
value. 

4 .  Worth  of  an  Experiment 

It  may  be  possible  to  apply  the  idea  of  relative 
value  to  a  single  experiment  by  considering  different  forms 
of  the  same  experiment  and  examining  how  they  contribute  to 
the  objective  of  the  experiment  in  question.   An  indication 
of  the  value  of  a  proposed  change  in  the  form  of  an  experiment 
would  be  the  change  in  the  relative  value  of  that  experiment 
caused  by  the  change  in  form. 

D.   A  PROPOSAL 

It  is  proposed  that  the  model  be  considered  for  use  in 
the  planning  of  CDEC ' s  experimentation.   The  model  as  de- 
scribed is  greatly  simplified  but  can  be  adapted  for  use  at 
CDEC  by  increasing  the  number  of  resources  and  time  periods 
to  a  useful  level.   Specifically,  the  model  can  be  used  in 
the  Project  Analysis  stage  of  experimentation  planning. 

Recall  that  the  purpose  of  a  Project  Analysis  was  to 
develop  a  concept  for  experimentation  that  would  best  satisfy 
experimental  objectives  within  available  resources  and  time 
constraints.   The  first  task  of  the  Project  Analysis  group 
was  to  analyze  experimental  objectives  to  determine  specific 
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tasks.   This  is  also  the  first  step  required  in  the  model; 
the  detailed  component  analysis.   The  Project  Analysis  Group 
next  considered  the  resources  available  and  the  experimental 
requirements.   Finally  the  group  proposed  a  schedule  for 
the  experiment  under  consideration.   The  model  is  designed  to 
aid  in  all  these  tasks.   Its  use  can  provide  a  better  under- 
standing of  the  structure  of  experiments  and  can  aid  in  the 
efficient  allocation  of  resources  to  experiments. 
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APPENDIX  A 


PRELIMINARY 
USER  INFORMATION  MANUAL 

ARRIBA 

AN  ALL-INTEGER 
PROGRAMMING  SYSTEM 


February  25,  1969 


Written  by: 

R.E.  Woolsey,  Candia  Corp.  and  University 

of  Texas 
Brady  Holcolm,  Union  Carbide 
Peter  Ryan,  Stanford  University 
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ARRIBA  USERS  MANUAL 


The  ARRIBA  system  facilitates  the  solution  of  small  integer 
programming  problems  by  a  variety  of  solution  algorithms. 
Input  is  standard  "SHARE'.'   The  system  is  written  in  a  basic 
FORTRAN  to  facilitate  conversion  to  various  machines.   The 
system  is  open  ended  in  the  sense  that  new  solution  algorithms 
are  relatively  easy  to  add. 


1.  CONTROLS,  CARD: 

The  first  card  in  any  problem  deck  must  be  a  CONTROLS, 
card.   If  it  is  not  found,  the  program  will  test  for  an  EXIT 
card.   If  an  EXIT  card  is  not  found,  the  problem  is  terminated 
with  ISTAT  =  18,  and  the  program  searches  forward  until  anoth- 
er CONTROLS  card  is  encountered.   The  format  of  the  card  is 
seen  below,  CC.  1-80.   CONTROLS,  LIST  =  A,  OBJ  VALUE  EVERYAAAA, 
ACTIVITY  LIST  EVERYAAAAA,  PIVOT  LIMITAAAAAAAA 

Options:   A.   LIST  =  1,  prints  input  data  on  the  standard 

output. 
LIST  =  0,  suppress  printing  of  input  data 
(cc. 15) . 

B.  OBJ  VALUE  EVERY  ,  gives  value  of 

objective  function  every  xxxxth  iteration 

(CC.  31-34). 

C.  ACTIVITY  LIST  EVERY  ,  gives  values  of 

all  variables  every  xxxxx  iteration  (CC.  56-69). 

D.  PIVOT  LIMIT ,  sets  pivot  limit 

for  the  problems  (CC. 73-80). 

E.  If  the  card  is  "CONTROLS,"  only,  then  the 
parameters  are  set  to  0,  10,  1000,  and  9999, 
respectively. 

2.  TITLE,  CARD: 

The  second  card  in  a  problem  deck  must  be  a  TITLE,  card. 
The  user  may  put  anything  desired  in  the  remaining  74  columns. 
The  title  card  is  always  printed  on  the  output  listing.   The 
first  six  characters  of  the  title  supplied  by  the  user  will 
appear  on  all  output  and  will  serve  as  the  identifying  refer- 
ence in  batched  jobs.   Error  Message:   If  TITLE  card  is  not 
encountered,  problem  terminates  with  ISTAT  =  2. 
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3.   ROW  ID  CARD: 

The  third  card  in  a  problem  must  be  a  ROW  ID  card,  fol- 
lowed immediately  by  the  ROW  Identification  cards  in  the 
following  format: 

Card  Column  1-11:   These  columns  must  be  blank. 

Card  Column   12:   This  column  is  used  to  identify  the 

type  of  constraint  as  follows: 

CC  12  =  +     Implies  that  the  constraint  is  of  the 
form  <^. 

CC  12  =  -     Implies  that  the  constraint  is  of  the 
form  £. 

CC  12  =      Implies  that  the  constraint  is  of  the 
form  =. 

Card  Columns  13-18:  This  field  is  used  as  the  name  of  the 

row  in  six  alphanumeric  characters. 


Note:   The  first  row  is  always  the  name  of  the  objective 
function  row;  and  for  this  row  the  only  types  allowed  in 
card  column  12  are  +  (minimize)  or  -  (maximize) . 

Error  Message:   If  ROW  ID  card  is  not  found,  problem 
terminates  with  ISTAT  =3.   If  row  name  appears  twice,  problem 
terminates  with  ISTAT  =  4. 


4.   EOR  CARD: 

The  card  terminating  the  definition  of  rows  must  be  an 
EOR.  Error  Message:  If  an  EOR  is  not  found,  problem  ter- 
minates with  ISTAT  =  4. 


5.   MATRIX  CARD: 

The  MATRIX  card  signals  that  the  body  of  the  matrix  fol- 
lows.  It  is  followed  immediately  by  the  matrix  entry  cards 
in  the  following  format: 

CC.    1-6   Blank 

CC.    7-12  Column  identification  of  six  alphanumeric 
characters . 

CC.   13-18  Row  identification  of  six  alphanumeric 
characters . 


CC.   19-30  Value  of  matrix  coefficient  read  in  with 
F12.6  specification. 

Note:   The  first  column  read  in  must  be  the  right-hand  side 
of  the  problem.   All  other  columns  are  read  in  from  left  to 
right  across  the  matrix.   In  the  columns  the  non-zero  entries 
are  read  from  the  top  down  (see  examples) . 

Error  Message.   If  a  MATRIX  card  is  not  found,  problem  ter- 
minates with  ISTAT  =5.   If  matrix  entry  is  out  of  sequence, 
problem  terminates  with  ISTAT  =6. 


6.   EOR  CARD: 

The  card  terminating  the  matrix  entries  must  be  an  EOR. 
Error  Messate:   If  an  EOR  not  found,  problem  terminates  with 
ISTAT  =  6. 


7.   BASIS  CARD: 

The  BASIS  Card  may  appear  after  the  matrix  EOR  and  signals 
that  some  starting  solution  values  are  to  be  imposed  on  the 
solution.   This  card  is  followed  immediately  by  the  BASIS 
entry  cards  in  the  following  format: 

CC.   1-6    Blank 

CC.   7-12   Six-character  alphanumeric  column  name. 

CC.  19-30   Value  of  the  variable  read  in  with  F12.6 
specification. 

If  an  imposed  basis  is  used,  the  last  BASIS  entry  card 
must  be  followed  by  an  EOR  card  (see  below) . 

WARNING:   This  option  must  be  used  with  great  care;  for 
when  a  basis  is  proposed  such  as  x,  =  5.0,  this  by  implication 
adds  to  the  original  problem  the  constraint  x,  -^  5.0.   Thus 
if  the  algorithm  converges  to  an  optimum  solution,  it  is  an 
optimum  of  the  augmented  (imposed  basis)  problem  and  not 
necessarily  an  optimum  of  the  original. 


Error  Message:   If  BASIS  Card  not  found,  no  error  message 
will  appear;  the  program  will  assume  that  the  card  is  an 
algorithm  card  and  proceed  accordingly. 


8.   EOR  CARD: 

This  card  is  necessary  only  if  a  preceding  BASIS  card 
is  used. 
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Error  Message:   If  EOR  card  not  found,  problem  terminates 
with  ISTAT  =  8. 


9.   ALGORITHM  CARD: 

This  card  identifies  the  algorithm  desired  for  application 
to  the  foregoing  problem.   The  present  algorithms  in  the 
ARRIBA  system  are  as  follows: 

CC.   1-4   IPSC  -  A  Gomory  cutting  plane  code  with  a  row- 
ordering  pivot  choice  rule. 

CC.   1-6  PRIMAL  -  A  primal  cutting  plane  code  based  on 

the  algorithm  of  Harris. 

CC.   1-6BALASG  -  A  version  of  the  original  Balas  zero- 
one  algorithm  with  the  changes  suggested 
by  Glover. 


Error  Messages:  If  an  ALGORITHM  card  is  not  found,  the 
program  terminated  the  problem  and  prints  "AGENDUM  CARD  RE- 
QUESTS INTEGER  ALGORITHM  NOT  PRESENTLY  IN  ARRIBA." 

CC.  78-80  Upper  bound  on  solution  (lUPBND)  used  with  IPSC 
and  PRIMAL. 

As  we  define  the  matrix  under  consideration  to  be  of  the 
form: 

N 
s.  =b.  +   Z   a..(-x.)  i=2,  ...,  M 
1     1    j=2   ^^    3 


If  the  matrix  is  not  lexicographically  dual  feasible 
(i.e.,  there  exists  at  least  one  non-positive  first  non- 
zero column  element) ,  ARRIBA  transforms  the  matrix  into 
usable  form  by  defining  the  variable. 


Z  =  lUPBND  +   Z   (-X.) 
jes     -' 

where  s  is  the  set  of  negative  columns  and  lUPBND  is  an  upper 
bound  on  the  sum  of  the  variables  in  s.   We  now  replace  J2f 
the  smallest  column  in  s.  by  the  substitution: 


X.   =  IPUBND  +   E    (-x.)-Z. 

D  •  •        D   — 

1  ^es 


60 


In  this  manner/  the  problem  is  brought  into  dual  feasible 
form. 

It  should  be  noted  that  lUPBND  is  selected  as  very  large, 
the  problem  may  run  an  excessive  number  of  iterations.   How- 
ever, if  lUPBND  is  selected  smaller  than   Z   (-x.)  at  the 

jes     -^ 
optimal  solution,  the  optimal  solution  will  never  be  reached. 
Some  analysis  of  the  problem  is,  therefore,  necessary  to 
avoid  either  of  the  two  situations  above. 


10.  ARRIBA  CARD: 

This  card  signals  the  program  to  begin  computation. 

Error  Message:   If  an  ARRIBA  card  is  not  found,  the 
problem  terminates  v/ith  "ISTAT  =  12. 

11.  EXIT  CARD: 

This  card  signals  the  end  of  all  jobs  and  exite  the 
program. 

Error  Message:   If  an  EXIT  card  is  not  found,  the  problem 
terminates  with  ISTAT  =  18. 
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COMPUTER    PROGRAM 


//  EXEC  PGM=ARRIBA,REGI0N=150K 

//STEPLI3       DD         niSP=SHR,DSN=F0953.AkRIBAt VDL=SER=CEL002,UNI 

//FTJ6F331    DD     SYSOUT  =  D ,DC B= ( RECFM= FB A , BLKS I ZE  =  33 25 , LRECL= 1 33 

//FTO^FOOl       DD       * 

CONTROLS, LIST=10BJ    ^ALUE     EVERY  99 

ACTIVITY    LIST    EVERY  1000       PIVOT    LIMIT       9999 

TITLE       RESOURCE    ALL3CATI0N    FOR    EXPERIMENTS 

ROW    10 


-ROWl 

+  R0W2 

+  R0W3 

+  R0W4 

+  R0W5 

■I-R0W6 

+  R0W7 

+  R0W8 

^-R0W9 

+R0W10 

4- ROWl  1 

+R0W12 

+R0W13 

+R0W14 

+R0W15 

■1- ROW  16 

+R0W17 

4-R0W18 

+R0W19 

+R0W20 

+R0W21 

■•■ROW22 

+R0W23 

+R0W2  4 

+R0W25 

+R0W2  6 

+ROW2  7 

. 

+R0W2a 

+R0W29 

• 

+R0W30 

+R0W31 

+R0W32 

EOR 

MATRIX 

COLO 

R0W2 

100,000000 

COLO 

R0W3 

110.  000000 

COLO 

ROW^ 

110.000000 

COLO 

ROW  5 

120. OJOOJO 

COLO 

RUW6 

30.033000 

COLO 

ROW  7 

30.  000000 

COLO 

ROW  8 

32.000000 

COL  J 

R0W9 

3  5.  OJDOOO 

COLO 

ROW  10 

500. 000000 

COLO 

ROW  11 

500.0000DO 

COLO 

R0W12 

500. 000000 

COLO 

ROWl  3 

500.000000 

COLO 

ROWl  4 

1.0 03 3 30 

COLO 

ROWl  5 

1.000000 

COLO 

ROWl  6 

1.0000 00 

COLO 

R  0  W  1  7 

1.  0  33  0  00 

COLO 

ROW  18 

1. 000000 

COLO 

R0W19 

1.000000 

COLO 

R0W20 

1. 000000 

COLO 

R0W21 

1.000000 

COLO 

ROW22 

1.033033 

COLO 

RCW23 

1.000000 

COLO 

R0W24 

1.000000 

COLO 

ROW25 

1. 033000 

COLO 

RCW26 

1.000000 

COLO 

ROW 2  7 

1.000033 

COLO 

RnW23 

1. 000000 

COLO 

R0W2  9 

I. 000000 

COLO 

RO  W3  0 

i.jj:)03d 

COLO 

R0W3  1 

I. 000000 

63 


COLO 

ROW32 

1. 

000000 

CGLl 

ROWl 

163. 

o}d:)JO 

COLl 

RQW2 

30. 

OOGOOO 

COLl 

ROW  3 

30. 

000000 

COLl 

RQVJ6 

5. 

000000 

COLl 

R0V-.'7 

5. 

000000 

COLl 

ROVilO 

20J. 

oooooo 

COLl 

ROW  11 

200. 

000000 

COLl 

ROWl^ 

1. 

oooooo 

COLl 

R  3  W2  8 

1. 

oooooo 

CGL2 

ROWl 

168. 

oooooo 

C0L2 

ROW  I 

252. 

oooooo 

C0L2 

R0W3 

30. 

oooooo 

COL  2 

R0W4 

30. 

oooooo 

cnL2 

ROW  7 

5. 

oooooo 

C0L2 

ROWS 

5. 

oooooo 

C0L2 

ROW  11 

200. 

oooooo 

C0L2 

ROWl  2 

200. 

33:)D  :iD 

C0L2 

ROWl  5 

1. 

oooooo 

C0L2 

R0W23 

1. 

oooooo 

C0L3 

ROWl 

168. 

oooooo 

C0L3 

ROWl 

252. 

oooooo 

C0L3 

ROW^ 

30. 

oooooo 

COL  3 

ROW  5 

30. 

oooooo 

C0L3 

ROW  8 

5. 

oooooo 

C0L3 

R0W9 

5. 

oooooo 

C0L3 

ROW  12 

200. 

oooooo 

C0L3 

ROW  13 

200. 

oooooo 

C0L3 

R0W16 

1. 

oooooo 

C0L3 

ROW  2  8 

1. 

oooooo 

COL^ 

ROWl 

^32. 

oooooo 

C0L4 

RnW3 

50. 

oooooo 

C0L4 

ROn'4 

50. 

oooooo 

COL^ 

ROWp 

50. 

j:ijjj:) 

caL4 

R3W7 

5. 

oooooo 

COL-V 

ROWS 

5. 

oooooo 

C0L4 

R0W9 

5. 

oooooo 

C0L4 

ROWl  1 

200. 

oooooo 

COL^ 

ROW  12 

2  00. 

oooooo 

C0L4 

ROW  13 

200. 

oooooo 

COL  4 

R0a17 

1. 

.ccoooo 

C0L4 

RQW29 

1. 

o}j:>jd 

C0L5 

ROWl 

432. 

oooooo 

CGL5 

R0W2 

50. 

,000000 

C0L5 

RQW3 

50. 

oooooo 

C0L3 

R0W4 

50. 

oooooo 

CQL5 

R0W6 

5. 

0  00  0  3  0 

C0L5 

ROW  7 

5. 

oooooo 

C0L5 

ROWS 

5, 

,000000 

COL  5 

ROW  10 

2  0  0, 

,  oooooo 

C0L5 

ROWl  1 

200. 

oooooo 

C0L5 

ROWl  2 

2C0. 

,000000 

C0L3 

ROW  13 

1. 

oooooo 

C0L5 

R0W29 

1. 

, oooooo 

C0L6 

ROWl 

176, 

,0000  00 

COL  6 

RCW3 

40. 

oooooo 

C0L6 

Rnw4 

4  0. 

0  JO  0  00 

C0L6 

ROW  5 

40, 

, oooooo 

COLS 

RO.^7 

2  0, 

,000000 

COLO 

RCW8 

2  0. 

.  oooooo 

C0L6 

ROW  9 

20. 

,000000 

C0L6 

ROWll 

1  00, 

,00  00  00 

C0L6 

R3W12 

IOC. 

, oooooo 

COLb 

ROV.13 

100, 

,0  000  00 

C0L6 

ROWl  9 

1. 

, oooooo 

C0L6 

OC,-.30 

1, 

.000000 

C0L7 

RO.a 

176, 

,000000 

COLT 

R0,>'2 

4  0, 

, oooooo 

C0L7 

R0.v3 

40, 

►oooooo 

C0L7 

ROW^ 

40, 

,000000 

COL  7 

RCW6 

20, 

. oooooo 

C0L7 

ROW  7 

20, 

.000000 
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C0L7 

ROWS 

20.  030000 

COL? 

ROW  10 

100.000000 

cnL7 

ROWll 

100.000000 

C0L7 

R0W12 

100. 000000 

C0L7 

R0W20 

I. 000000 

C0L7 

RGW30 

l,3D33:)3 

COLS 

RDWl 

104. 000000 

COLB 

R0W2 

30.000000 

C0L8 

R0W3 

30. 00DO3O 

C0L8 

ROW  6 

15. 000000 

COLB 

ROW  7 

15.00G000 

C0L8 

R  0  a'  1  0 

80. 003000 

CGL8 

ROWll 

80.000000 

COLB 

R0W21 

I. 0000 00 

COL  8 

R0W31 

1. 000000 

C0L9 

ROWl 

104.000000 

C0L9 

ROW  3 

30.000000 

C0L9 

Rnw4 

30.000000 

C0L9 

P0W7 

15.0  000  00 

C0L9 

ROWS 

15. OJOOOO 

C0L9 

ROWll 

8  0. 0  0  00  00 

C0L9 

ROWl  2 

80,000000 

C0L9 

R0W22 

1. 000000 

C0L9 

ROW  3  1 

1.0  000  00 

COIJ 

ROWl 

104.0  000  3  0 

COlO 

RCW4 

30.  000000 

COlO 

R0W5  ■ 

3  0.0  000  00 

CO  10 

ROW  3 

15.  0  000  00 

COlO 

R0W9 

15.000000 

COlO 

ROW  12 

80.000000 

COlO 

ROWl  3 

80.  000000 

COlO 

ROV/23 

1.000000 

COlO 

R0W31 

1. 3  0  30  JO 

ceil 

ROWl 

120.000000 

con 

R0W2 

20.000000 

con 

KCW6 

10.  0  330  00 

con 

ROW  10 

50.000000 

con 

RGW2  4 

1.00C030 

con 

R0W32 

1. 000000 

CO  12 

ROWl 

120.000000 

C012 

R0W3 

2  0,  3  3:):)  20 

C012 

ROW  7 

10. 000000 

cm  2 

ROWll 

5  0.0  000  00 

C012 

RCW25 
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